A review of economic analysis in the vaccination program; decision making and governance: Adivisory Committee on Immunization Practices (ACIP)

The Advisory Committee on Immunization Practices (ACIP) develops written recommendations for the routine administration of vaccines to children and adults in the U.S. civilian population. The ACIP is the only entity in the federal government that makes such recommendations. ACIP elaborates on selection of its members and rules out concerns regarding its integrity, but fails to provide information about the importance of economic analysis in vaccine selection. ACIP recommendations can have large health and economic consequences. Emphasis on economic evaluation in health is a likely response to severe pressures of the federal and state health budget. This study describes the economic aspects considered by the ACIP while sanctioning a vaccine, and reviews the economic evaluations (our economic data) provided for vaccine deliberations. A five year study period from 2004 to 2009 is adopted. Publicly available data from ACIP web database is used. Drummond et al. (2005) checklist serves as a guide to assess the quality of economic evaluations presented. Drummond et al.'s checklist is a comprehensive hence it is unrealistic to expect every ACIP deliberation to meet all of their criteria. For practical purposes we have selected seven criteria that we judge to be significant criteria provided by Drummond et al. Twenty-four data points were obtained in a five year period. Our results show that out of the total twenty-four data point‘s (economic evaluations) only five data points received a score of six; that is six items on the list of seven were met. None of the data points received a perfect score of seven. Seven of the twenty-four data points received a score of five. A minimum of a two score was received by only one of the economic analyses. The type of economic evaluation along with the model criteria and ICER/QALY criteria met at 0.875 (87.5%). These three criteria were met at the highest rate among the seven criteria studied. Our study findings demonstrate that the perspective criteria met at 0.583 (58.3%) followed by source and sensitivity analysis criteria both tied at 0.541 (54.1%). The discount factor was met at 0.250 (25.0%).^ Economic analysis is not a novel concept to the ACIP. It has been practiced and presented at these meetings on a regular basis for more than five years. ACIP‘s stated goal is to utilize good quality epidemiologic, clinical and economic analyses to help policy makers choose among alternatives presented and thus achieve a better informed decision. As seen in our study the economic analyses over the years are inconsistent. The large variability coupled with lack of a standardized format may compromise the utility of the economic information for decision-making. While making recommendations, the ACIP takes into account all available information about a vaccine. Thus it is vital that standardized high quality economic information is provided at the ACIP meetings. Our study may provide a call for the ACIP to further investigate deficiencies within the system and thereby to improve economic evaluation data presented. ^

Home care service utilization in British Columbia: Substitute or complement to acute care?

The desire to promote efficient allocation of health resources and effective patient care has focused attention on home care as an alternative to acute hospital service. in particular, clinical home care is suggested as a substitute for the final days of hospital stay. This dissertation evaluates the relationship between hospital and home care services for residents of British Columbia, Canada beginning in 1993/94 using data from the British Columbia Linked Health database. ^ Lengths of stay for patients referred to home care following hospital discharge are compared to those for patients not referred to home care. Ordinary least squares regression analysis adjusts for age, gender, admission severity, comorbidity, complications, income, and other patient, physician, and hospital characteristics. Home care clients tend to have longer stays in hospital than patients not referred to home care (β = 2.54, p = 0.0001). Longer hospital stays are evident for all home care client groups as well as both older and younger patients. Sensitivity analysis for referral time to direct care and extreme lengths of stay are consistent with these findings. Two stage regression analysis indicates that selection bias is not significant.^ Patients referred to clinical home care also have different health service utilization following discharge compared to patients not referred to home care. Home care nursing clients use more medical services to complement home care. Rehabilitation clients initially substitute home care for physiotherapy services but later are more likely to be admitted to residential care. All home care clients are more likely to be readmitted to hospital during the one year follow-up period. There is also a strong complementary association between direct care referral and homemaker support. Rehabilitation clients have a greater risk of dying during the year following discharge. ^ These results suggest that home care is currently used as a complement rather than a substitute for some acute health services. Organizational and resource issues may contribute to the longer stays by home care clients. Program planning and policies are required if home care is to provide an effective substitute for acute hospital days. ^

Logistic regression models for ordinal response: A study of self-efficacy in colorectal cancer screening

The ordinal logistic regression models are used to analyze the dependant variable with multiple outcomes that can be ranked, but have been underutilized. In this study, we describe four logistic regression models for analyzing the ordinal response variable. ^ In this methodological study, the four regression models are proposed. The first model uses the multinomial logistic model. The second is adjacent-category logit model. The third is the proportional odds model and the fourth model is the continuation-ratio model. We illustrate and compare the fit of these models using data from the survey designed by the University of Texas, School of Public Health research project PCCaSO (Promoting Colon Cancer Screening in people 50 and Over), to study the patient’s confidence in the completion colorectal cancer screening (CRCS). ^ The purpose of this study is two fold: first, to provide a synthesized review of models for analyzing data with ordinal response, and second, to evaluate their usefulness in epidemiological research, with particular emphasis on model formulation, interpretation of model coefficients, and their implications. Four ordinal logistic models that are used in this study include (1) Multinomial logistic model, (2) Adjacent-category logistic model [9], (3) Continuation-ratio logistic model [10], (4) Proportional logistic model [11]. We recommend that the analyst performs (1) goodness-of-fit tests, (2) sensitivity analysis by fitting and comparing different models.^

Proton therapy versus intensity modulated x-ray therapy in the treatment of prostate cancer: Estimating secondary cancer risks

External beam radiation therapy is used to treat nearly half of the more than 200,000 new cases of prostate cancer diagnosed in the United States each year. During a radiation therapy treatment, healthy tissues in the path of the therapeutic beam are exposed to high doses. In addition, the whole body is exposed to a low-dose bath of unwanted scatter radiation from the pelvis and leakage radiation from the treatment unit. As a result, survivors of radiation therapy for prostate cancer face an elevated risk of developing a radiogenic second cancer. Recently, proton therapy has been shown to reduce the dose delivered by the therapeutic beam to normal tissues during treatment compared to intensity modulated x-ray therapy (IMXT, the current standard of care). However, the magnitude of stray radiation doses from proton therapy, and their impact on this incidence of radiogenic second cancers, was not known. ^ The risk of a radiogenic second cancer following proton therapy for prostate cancer relative to IMXT was determined for 3 patients of large, median, and small anatomical stature. Doses delivered to healthy tissues from the therapeutic beam were obtained from treatment planning system calculations. Stray doses from IMXT were taken from the literature, while stray doses from proton therapy were simulated using a Monte Carlo model of a passive scattering treatment unit and an anthropomorphic phantom. Baseline risk models were taken from the Biological Effects of Ionizing Radiation VII report. A sensitivity analysis was conducted to characterize the uncertainty of risk calculations to uncertainties in the risk model, the relative biological effectiveness (RBE) of neutrons for carcinogenesis, and inter-patient anatomical variations. ^ The risk projections revealed that proton therapy carries a lower risk for radiogenic second cancer incidence following prostate irradiation compared to IMXT. The sensitivity analysis revealed that the results of the risk analysis depended only weakly on uncertainties in the risk model and inter-patient variations. Second cancer risks were sensitive to changes in the RBE of neutrons. However, the findings of the study were qualitatively consistent for all patient sizes and risk models considered, and for all neutron RBE values less than 100. ^

HIV incidence estimates and HIV/AIDS concurrent diagnosis in Houston/Harris County

The purpose of this dissertation was to estimate HIV incidence among the individuals who had HIV tests performed at the Houston Department of Health and Human Services (HDHHS) public health laboratory, and to examine the prevalence of HIV and AIDS concurrent diagnoses among HIV cases reported between 2000 and 2007 in Houston/Harris County. ^ The first study in this dissertation estimated the cumulative HIV incidence among the individuals testing at Houston public health laboratory using Serologic Testing Algorithms for Recent HIV Seroconversion (STARHS) during the two year study period (June 1, 2005 to May 31, 2007). The HIV incidence was estimated using two independently developed statistical imputation methods, one developed by the Centers for Disease Control and Prevention (CDC), and the other developed by HDHHS. Among the 54,394 persons who tested for HIV during the study period, 942 tested HIV positive (positivity rate=1.7%). Of these HIV positives, 448 (48%) were newly reported to the Houston HIV/AIDS Reporting System (HARS) and 417 of these 448 blood specimens (93%) were available for STARHS testing. The STARHS results showed 139 (33%) out of the 417 specimens were newly infected with HIV. Using both the CDC and HDHHS methods, the estimated cumulative HIV incidences over the two-year study period were similar: 862 per 100,000 persons (95% CI: 655-1,070) by CDC method, and 925 per 100,000 persons (95% CI: 908-943) by HDHHS method. Consistent with the national finding, this study found African Americans, and men who have sex with men (MSM) accounted for most of the new HIV infections among the individuals testing at Houston public health laboratory. Using CDC statistical method, this study also found the highest cumulative HIV incidence (2,176 per 100,000 persons [95%CI: 1,536-2,798]) was among those who tested in the HIV counseling and testing sites, compared to the sexually transmitted disease clinics (1,242 per 100,000 persons [95%CI: 871-1,608]) and city health clinics (215 per 100,000 persons [95%CI: 80-353]. This finding suggested the HIV counseling and testing sites in Houston were successful in reaching high risk populations and testing them early for HIV. In addition, older age groups had higher cumulative HIV incidence, but accounted for smaller proportions of new HIV infections. The incidence in the 30-39 age group (994 per 100,000 persons [95%CI: 625-1,363]) was 1.5 times the incidence in 13-29 age group (645 per 100,000 persons [95%CI: 447-840]); the incidences in 40-49 age group (1,371 per 100,000 persons [95%CI: 765-1,977]) and 50 or above age groups (1,369 per 100,000 persons [95%CI: 318-2,415]) were 2.1 times compared to the youngest 13-29 age group. The increased HIV incidence in older age groups suggested that persons 40 or above were still at risk to contract HIV infections. HIV prevention programs should encourage more people who are age 40 and above to test for HIV. ^ The second study investigated concurrent diagnoses of HIV and AIDS in Houston. Concurrent HIV/AIDS diagnosis is defined as AIDS diagnosis within three months of HIV diagnosis. This study found about one-third of the HIV cases were diagnosed with HIV and AIDS concurrently (within three months) in Houston/Harris County. Using multivariable logistic regression analysis, this study found being male, Hispanic, older, and diagnosed in the private sector of care were positively associated with concurrent HIV and AIDS diagnoses. By contrast, men who had sex with men and also used injection drugs (MSM/IDU) were 0.64 times (95% CI: 0.44-0.93) less likely to have concurrent HIV and AIDS diagnoses. A sensitivity analysis comparing difference durations of elapsed time for concurrent HIV and AIDS diagnosis definitions (1-month, 3-month, and 12-month cut-offs) affected the effect size of the odds ratios, but not the direction. ^ The results of these two studies, one describing characteristics of the individuals who were newly infected with HIV, and the other study describing persons who were diagnosed with HIV and AIDS concurrently, can be used as a reference for HIV prevention program planning in Houston/Harris County. ^

Specialized managed care for children with cystic fibrosis: Resource use patterns and rate design for a high cost Medicaid population

Objective. This research study had two goals: (1) to describe resource consumption patterns for Medi-Cal children with cystic fibrosis, and (2) to explore the feasibility from a rate design perspective of developing specialized managed care plans for such a special needs population.^ Background. Children with special health care needs (CSHN) comprise about 2% of the California Medicaid pediatric population. CSHN have rare but serious health problems, such as cystic fibrosis. Medicaid programs, including Medi-Cal, are enrolling more and more beneficiaries in managed care to control costs. CSHN, however, do not fit the wellness model underlying most managed care plans. Child health advocates believe that both efficiency and quality will suffer if CSHN are removed from regionalized special care centers and scattered among general purpose plans. They believe that CSHN should be "carved out" from enrollment in general plans. One alternative is the Specialized Managed Care Plan, tailored for CSHN.^ Methods. The study population consisted of children under age 21 with CF who were eligible for Medi-Cal and California Children's Services program (CCS) during 1991. Health Care Financing Administration (HCFA) Medicaid Tape-to-Tape data were analyzed as part of a California Children's Hospital Association (CCHA) project.^ Results. Mean Medi-Cal expenditures per month enrolled were $2,302 for 457 CF children, compared to about \$1,270 for all 47,000 CCS special needs children and roughly $60 for almost 2.6 million ``regular needs'' children. For CF children, inpatient care (80\%) and outpatient drugs (9\%) were the major cost drivers, with {\it all\/} outpatient visits comprising only 2\% of expenditures. About one-third of CF children were eligible due to AFDC (Aid to Families with Dependent Children). Age group explained about 17\% of all expenditure variation. Regression analysis was used to select the best capitation rate structure (rate cells by age and eligibility group). Sensitivity analysis estimated moderate financial risk for a statewide plan (360 enrollees), but severe risk for single county implementation due to small numbers of children.^ Conclusions. Study results support the carve out of CSHN due to unique expenditure patterns. The Specialized Managed Care Plan concept appears feasible from a rate design perspective given sufficient enrollees. ^

Evaluation of a wellness program at a large private sector petrochemical company in Texas

The study purpose was to analyze the effects Integrated Health Solutions (IHS), an employee wellness program that has been implemented for one year on the corporate campus of a major private sector petrochemical company in Houston, TX, has on employee health. ^ Chronic diseases are the leading causes of morbidity and mortality in the United States and are the most preventable of all health problems. The costs of chronic diseases in the working-age adult population include not only health problems and a decrease in quality of life, but also an increase the cost of health care and costs to businesses and employers, both directly and indirectly. These emerging costs to employers as well as the fact that adults now spend the majority of waking hours at the office have increased the interest in worksite health promotion programs that address many of the behavioral factors that lead to chronic conditions. Therefore, implementing and evaluating programs that are aimed at promoting health and decreasing the prevalence of chronic diseases at worksites is very important. ^ Data came from existing data that were collected by IHS staff during employee biometric screenings at the company in 2010 and 2011. Data from employees who participated in screenings in both 2010 and 2011 were grouped into a cohort by IHS staff. ^ One-tailed t-tests were conducted to determine if there were significant improvements in the biometric measures of body fat percentage, BMI, waist circumference, systolic and diastolic blood pressures, total, HDL, and LDL cholesterol levels, triglycerides, blood glucose levels, and cardiac risk ratios. Sensitivity analysis was conducted to determine if there were differences in program outcomes when stratified by age, gender, job type, and time between screenings. ^ Mean differences for the variables from 2010 to 2011 were small and not always in the desired direction for health improvement indicators. Through conducting t-tests, it was found that there were significant improvements in HDL, cardiac risk ratio, and glucose levels. There were significant increases in cholesterol, LDL, and diastolic blood pressures. For the IHS program, it appears that gender, job type, and time between screenings were possible modifiers of program effectiveness. When program outcome measures were stratified by these factors, results suggest that corporate employees had better outcomes than field employees, males had better outcomes overall than females, and more positive program effects were seen for employees with less time between their two screenings. ^ Recommendations for the program based on the results include ensuring validity of instruments and initial and periodic training of measurement procedures and equipment handling, using normative data or benchmarks to decrease chances for biased estimates of program effectiveness, measuring behaviors as well as biometric and physiologic statuses and changes, and collecting level of engagement data.^

Data quality in trauma transfusion studies and the impact of missing data on predicting massive transfusion

Maximizing data quality may be especially difficult in trauma-related clinical research. Strategies are needed to improve data quality and assess the impact of data quality on clinical predictive models. This study had two objectives. The first was to compare missing data between two multi-center trauma transfusion studies: a retrospective study (RS) using medical chart data with minimal data quality review and the PRospective Observational Multi-center Major Trauma Transfusion (PROMMTT) study with standardized quality assurance. The second objective was to assess the impact of missing data on clinical prediction algorithms by evaluating blood transfusion prediction models using PROMMTT data. RS (2005-06) and PROMMTT (2009-10) investigated trauma patients receiving ≥ 1 unit of red blood cells (RBC) from ten Level I trauma centers. Missing data were compared for 33 variables collected in both studies using mixed effects logistic regression (including random intercepts for study site). Massive transfusion (MT) patients received ≥ 10 RBC units within 24h of admission. Correct classification percentages for three MT prediction models were evaluated using complete case analysis and multiple imputation based on the multivariate normal distribution. A sensitivity analysis for missing data was conducted to estimate the upper and lower bounds of correct classification using assumptions about missing data under best and worst case scenarios. Most variables (17/33=52%) had <1% missing data in RS and PROMMTT. Of the remaining variables, 50% demonstrated less missingness in PROMMTT, 25% had less missingness in RS, and 25% were similar between studies. Missing percentages for MT prediction variables in PROMMTT ranged from 2.2% (heart rate) to 45% (respiratory rate). For variables missing >1%, study site was associated with missingness (all p≤0.021). Survival time predicted missingness for 50% of RS and 60% of PROMMTT variables. MT models complete case proportions ranged from 41% to 88%. Complete case analysis and multiple imputation demonstrated similar correct classification results. Sensitivity analysis upper-lower bound ranges for the three MT models were 59-63%, 36-46%, and 46-58%. Prospective collection of ten-fold more variables with data quality assurance reduced overall missing data. Study site and patient survival were associated with missingness, suggesting that data were not missing completely at random, and complete case analysis may lead to biased results. Evaluating clinical prediction model accuracy may be misleading in the presence of missing data, especially with many predictor variables. The proposed sensitivity analysis estimating correct classification under upper (best case scenario)/lower (worst case scenario) bounds may be more informative than multiple imputation, which provided results similar to complete case analysis.^

The influence of antibacterial susceptibility and pharmacodynamics on the therapeutic response of infection

This prospective cohort study estimated how antibacterial resistance affected the time until clinical response. Relative rates of improvement and cure were estimated by proportional-hazards regression for 391 patients with culture-confirmed bacterial keratitis who had the ciprofloxacin minimal inhibitory concentration (MIC) measured of the principal corneal isolate and who were treated with ciprofloxacin 0.3% solution or ointment. After adjusting for age and hypopyon status and stratifying by ulcer size, clinic, and ciprofloxacin formulation, the summary rate of clinical improvement with ciprofloxacin therapy was reduced by 42% (95% confidence limits [CL], 3%, 65%) among patients whose corneal isolate's ciprofloxacin MIC exceeded 1.0 μg/mL compared to those with more sensitive isolates. The summary rate of resolution to improvement and cure was reduced by 36% (95% CL, 11%, 53%) among corneal infections having a higher ciprofloxacin MIC. Rate ratios were modified by the size of the presenting corneal ulceration; for ulcer diameters of 4 mm or less and of more than 4 mm, improvement rate ratios were 0.56 (95% CL, 0.31, 1.02) and 0.65 (95% CL, 0.23, 1.80), respectively; resolution rate ratios were 0.63 (95% CL, 0.44, 0.91) and 0.67 (95% CL, 0.32, 1.39), respectively. Sensitivity analysis showed that the summary improvement rate ratio could be maximally overestimated by 24% (95% CL, −29%, 114%) because of informative censoring or by 33% (95% CL, −21%, 126%) from loss to follow up. Based on reported corneal pharmacokinetics of topical ciprofloxacin, the probability of clinical improvement was 90% or more if the ratio of the achievable corneal ciprofloxacin concentration to the corneal isolate's ciprofloxacin MIC was above 8 or the ratio of the area under the 24-hour corneal concentration curve to the ciprofloxacin MIC was greater than 151. This study suggests that corneal infections by bacteria having a higher ciprofloxacin MIC respond more slowly to ciprofloxacin treatment than those with a lower MIC. While the rate of clinical resolution is affected by patient age and clinical severity, antimicrobial susceptibility testing of corneal cultures can indicate the relative effectiveness of antibacterial therapy. A pharmacodynamic approach to treating bacterial keratitis offers the prospect of optimal antimicrobial selection and modification. ^

Molecular analysis of TNF sensitivity in normal and Ha-{\it ras\/} transformed murine fibroblasts

Tumor necrosis factor (TNF) is known to have antiproliferative effects on a wide variety of tumor cells but proliferative effects on normal cells. However, the molecular basis for such differences in the action of TNF are unknown. The overall objectives of my research are to investigate the role of oncogenes in TNF sensitivity and delineate some of the molecular mechanisms involved in TNF sensitivity and resistance. To accomplish these objectives, I transfected TNF-resistant C3H mouse embryo fibroblasts (10T1/2) with an activated Ha-ras oncogene and determined whether these cells exhibit altered sensitivity to TNF. The results indicated that 10T1/2 cells transfected with an activated Ha-ras oncogene (10T-EJ) not only produced tumors in nude mice but also exhibited extreme sensitivity to cytolysis by TNF. In contrast, 10T1/2 cells transfected with the pSV2-neo gene alone were resistant to the cytotoxic effects of TNF. I also found that TNF-induced cell death was mediated through apoptosis. The differential sensitivity of 10T1/2 and 10T-EJ cell lines to TNF was not due to differences in the number of TNF receptors on their cell surface. In addition, TNF-resistant revertants isolated from Ha-ras-transformed, TNF-sensitive cells still expressed the same amount of p21 as TNF-sensitive cells and were still tumorigenic, suggesting that Ha-ras-induced transformation and TNF sensitivity may follow different pathways. Interestingly, TNF-resistant but not sensitive cells expressed higher levels of bcl-2, c-myc, and manganese superoxide dismutase (MnSOD) mRNA following exposure to TNF. However, TNF treatment resulted in a marginal induction of p53 mRNA in both TNF-sensitive and resistant cells. Based on these results I can conclude that (i) Ha-ras oncogene induces both transformation and TNF sensitivity, (ii) TNF-induced cytotoxicity involves apoptosis, and (iii) TNF-induced upregulation of bcl-2, c-myc, and MnSOD genes is associated with TNF resistance in C3H mouse embryo fibroblasts. ^

TUMOR PROGRESSION: ANALYSIS OF THE INSTABILITY OF THE METASTATIC PHENOTYPE, SENSITIVITY TO RADIATION AND CHEMOTHERAPY (PHENOTYPIC DRIFT, BREAST CANCER)

The major complications for tumor therapy are (i) tumor spread (metastasis); (ii) the mixed nature of tumors (heterogeneity); and (iii) the capacity of tumors to evolve (progress). To study these tumor characteristics, the rat 13762NF mammary adenocarcinoma was cloned and studied for metastatic properties and sensitivities to therapy (chemotherapy, radiation and hyperthermia). The cell clones were heterogeneous and no correlation between metastatic potential and therapeutic sensitivities was observed. Further, these phenotypes were unstable during passage in vitro; yet, the changes were clone dependent and reproducible using different cryoprotected cell stocks. To understand the phenotypic instability, subclones were isolated from low and high passage cell clones. Each subclone possessed a unique composite phenotype. Again, no apparent correlation was seen between metastatic potential and sensitivity to therapy. The results demonstrated that (1) tumor cells are heterogeneous for multiple phenotypes; (2) tumor cells are unstable for multiple phenotypes; (3) the magnitude, direction and time of occurrence of phenotypic drift is clone dependent; (4) the sensitivity of cell clones to ionizing radiation (gamma or heat) and chemotherapy agents is independent of their metastatic potential; (5) shifts in metastatic potential and sensitivity to therapy may occur simultaneously but are not linked; and (6) tumor cells independently diverge to form several subpopulations with unique phenotypic profiles. ^